A trajectory approach to two-state kinetics of single particles on sculpted energy 

landscapes 



David Wu, 1 Kingshuk Ghosh, 2 Mandar Inamdar, 3 Heun Jin Lee, 1 Scott Fraser, 1 Ken Dill, 2 and Rob Phillips 1 ^ 

1 California Institute of Technology, Pasadena CA 
University of California, San Francisco CA 
!1 Indian Institute of Technology, Murabai, India 
(Dated: March 5, 2008) 

We study the trajectories of a single colloidal particle as it hops between two energy wells A and 
B, which are sculpted using adjacent optical traps by controlling their respective power levels and 
separation. Whereas the dynamical behaviors of such systems are often treated by master-equation 
methods that focus on particles as actors, we analyze them here instead using a trajectory-based 
variational method called Maximum Caliber, which utilizes a dynamical partition function. We 
show that the Caliber strategy accurately predicts the full dynamics that we observe in the experi- 
ments: from the observed averages, it predicts second and third moments and covariances, with no 
free parameters. The covariances are the dynamical equivalents of Maxwell-like equilibrium recip- 
rocal relations and Onsager-like dynamical relations. In short, this work describes an experimental 
model system for exploring full trajectory distributions in one-particle two-state systems, and it val- 
idates the Caliber approach as a useful way to understand trajectory-based dynamical distribution 
functions in this system. 

PACS numbers: 05.40.-a, 02.50.Tt, 05.45.Tp, 02.50.Fz 

Keywords: dynamical partition function nonequilibrium statistical mechanics optical trapping 



We explore the kinetics of two-state processes, A ±=> B. 
at the one-particle level. Examples of single-molecule or 
single-particle dynamical processes that mimic this two- 
state dynamics include DNA loop formation [I], RNA 
oligomer hairpin formation/destruction [2J, protein fold- 
ing oscillations [3] , sequence-dependent protein unfolding 
[1] , or ion-channel opening and closing kinetics [5] . Two- 
state fluctuating systems with constant rates are called 
random telegraph processes. 

One way to understand two-state and random- 
telegraph processes is through master equations, which 
are differential equations that are solved for time- 
dependent probability density functions [7]. For single- 
particle and few-particle systems, however, the most di- 
rect and convenient experimental observables are often 
the individual dynamical trajectories, rather than the 
density functions. Here, we describe an experimental 
model system to study single-particle two-state stochas- 
tic trajectories. We use these experiments to test a the- 
oretical strategy, called Maximum Caliber, that provides 
a way to predict the full trajectory distributions, given 
certain observed mean values. 

Using dual optical traps, we have sculpted various en- 
ergy landscapes. We can control the relative time the 
particle spends in its two states and the rate of transition- 
ing between them. Our method follows from earlier works 
on the dual trapping of colloidal particles that was used 
to study Kramers reaction rate theory [8]. While these 
experimental models were previously applied to study- 
ing average rates, our interest here is in the probability 
distribution of trajectories. 

We trap a 1 /im silica bead in a neighboring pair of 
optical traps. The laser at 532 nm, 100 mW, provides an 



inverted double- Gaussian shaped potential: an acousto- 
optic deflector alternately sets up two traps close together 
in space, at a switching rate of 10 kHz, which is much 
faster than each individual trap's corner frequency [9], 
and the fastest bead hopping rate. The strength of each 
trap and the spacing between them can be controlled in 
order to sculpt the shape of the potential. A tracking 
658 nm red laser at 1 mW was used to determine the po- 
sition of the bead. The red laser reduces by only a small 
degree the trapping efficiency of the green laser. The 
forward scattered light is imaged through a microscope 
condenser onto a position-sensitive detector [ID] . The 
green trapping laser light at the detector is filtered out 
by an interference filter that passes only red light. The 
data was recorded at a rate of 20 kHz, which sets the 
fundamental time step, At, for our analysis. Trajecto- 
ries were recorded for intervals ranging from 20 minutes 
to more than 1 hour, depending on the hopping rate. 
A simple threshold was used to determine states in the 
trajectories. 

To analyze our data, we use a variational principle 
called "Maximum Caliber" that purports to predict dy- 
namical properties in the same way that the principle of 
Maximum Entropy predicts equilibria Caliber has 

previously been shown to be a simple and useful way 
to derive the flux distributions in diffusive systems, such 
as in Fick's Law of particle transport, Fourier's Law of 
heat transport, and Newton's Viscosity Law of momen- 
tum transport [T5]. The Caliber approach is described 
in the Appendix. In short, we first enumerate the pos- 
sible trajectories. The equivalent of a partition function 
is then constructed as a sum over weights of the trajec- 
tories. Certain mean values are measured, which then 
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fixes the relative weight factors of the trajectories, re- 
sulting in the Caliber prediction for the full distribution 
function over the trajectories. Consider the types of tra- 
jectories shown in Figure [T] By trajectory, we mean one 
individual time sequence of events over which the parti- 
cle transitions back and forth many times between states 
A and B. We model our events, that is, transitions be- 
tween states, as taking place at discretized time intervals, 
At, set by the inverse of the sampling rate. A trajectory 
has N time steps, so it lasts for a total time NAt. We 
aim to characterize: (1) various dynamical averages over 
those trajectories and (2) the probability distribution of 
the many possible trajectories of the system. 
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FIG. 1: Sculpted energy landscapes (left, averaged 
20 minutes) and the corresponding microtrajectories. 

The trace is raw data; states are assigned after boxcar fil- 
tering and threshold finding. Top: the lower state is slightly 
more populated; there is a high barrier (infrequent transi- 
tions). Bottom: the upper state is more populated; the bar- 
rier is small (frequent transitions) . The distance between the 
two potential minima ranges from 200 nm to 700 nm. 



There are four unknown parameters (plus normaliza- 
tion) called Lagrange multipliers which we determine by 
measuring four other conjugate quantities, or observ- 
ables. These observables are the average number of times 
a switching event occurs between the same states (N aa ) 
and (Nbb), and between different states (N a b) and (Nb a ), 
in a certain trajectory. The unknown parameters conju- 
gate to these observables are the "statistical weights" a, 
P, ujf, and ui r , respectively, a is the statistical weight 
that, given that the system is in state A at time t, it is 
also in state A at time t + At; f3, for staying in state B 
at time t + At, given that the system was in B at time 
t; ujf, for switching from A to B in the time interval At; 
and ui r , for switching from B to A in the time interval 
At. 

The quantity Qd, the dynamical partition function, is 
the sum over the statistical weights of all the different 
time trajectories. For 5 = 2^ trajectories of length N 



time steps, the dynamical partition function is given by 



Qd = £ (^m u ^.^ 



(1) 



and the probability of a particular trajectory labeled i is 
given by 



Pi 



is the number of A 
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trajectory, for example. 

The Caliber strategy provides a way to compute all 
the higher-order cumulants of the trajectory observ- 
ables. To do this, we first obtain the values of the 
Lagrange multipliers by maximizing Qd subject to the 
experimentally observed averages, (N aa ), (Nbb), (N ab ), 
and (N^. For instance, (N ba ) = f£g± and 

Then, taking the second and 
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(N ab ) 

higher derivatives of Qd gives the higher cumulants of the 
observables, such as (N 2 a ) - (iV ba ) 2 = 

There are also other quantities of interest. Let Nb rep- 
resent the number of units of time that the system spends 
in state B. Then we have for each individual trajectory 
N B = N ab + N bb + N ob and N A = N aa + N ba + N Qa where 
Nob is 0(1) if the trajectory begins in state A(B) and No a 
is 1(0) if the trajectory begins in state A(B). If the num- 
ber of steps is sufficiently large, the contribution from 
initial conditions can be ignored. Hence the variance 

for N B is given by (N B ) - (N B ) 
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Mixed moments and covariances require mixed deriva- 
tives of Qd- For example, 
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(3) 



which leads to 
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= d(N ab ) 
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(N ab N b b) - (N ab )(N bb ). Hence, given Q d all trajectory 
observables and their fluctuations can be computed. 

A simple way to compute Qd is through the matrix 
propagator G, 



a UJ r 



(4) 



where each element of G represents the "statistical 
weight" of transitioning from some initial state dur- 
ing each time step. We consider here only stationary 
processes, for which the statistical weights are time- 
independent, but the Caliber method itself is not lim- 
ited to such simple dynamics. We can express Qd = 
(1 1) G^ -1 (ao bo) T , where N is the number of time 
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steps in the trajectory and (clq bo) denotes the initial 
state probabilties. Thus all the higher cumulants of the 
observables are analytically simple in the limit of large 
N (see Appendix). For non-stationary processes, the G 
matrix will differ at each time step. 

Functional similarities between microscopic models in 
statistical mechanics and equations of state in thermo- 
dynamics allows assignations of undetermined Lagrange 
multipliers in the Maximum Entropy formalism to phys- 
ically realizable quantities, such as (3 <-» T~ l [6 . We 
now make similar correspondences between the Caliber- 
derived "statistical weights" with probabilities. The four 
(exponentiated) Lagrange multipliers a, (3, uif, and ui r 
in matrix G are reminiscent of a Markov chain propaga- 
tor. Thus we choose to assign a <-> P(A,t + At \A,t), 
Lu f «-► P(B,t + At \A,t), (3 <-> P(B,t + At \B,t), and 
uj r <-> P (A, t + At \B,t); each is a probability of moving 
between or among states in time At. Thus a+ujf = 1 and 
(3 + uj r = 1 enforce probability conservation. G becomes 

[ u f u r \ anc j ^ e mas ^ er equation follows im- 
V u>f 1 — ui r J 

mediately. The advantage of the Caliber approach is that 
it readily provides information about trajectory observ- 
ables not obviously accesible from master equations. 

We now show tests of the Caliber predictions. First, 
given the first-moment averages observed for the trajec- 
tories, Caliber predicts the second moments. Figure [2] 
demonstrates two predicted second cumulants obtained 
from two partial derivatives of Qd- It is in good agree- 
ment with the experimental data. 
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FIG. 2: Second cumulant of the trajectory distribu- 
tion. The x-axes give the predicted second cumulants from 
the Caliber approach, based on the known first moments. The 
y-axes give the experimental values of the second moments. 
Left: variance of (Nb), right: variance of {Nba}- The dashed 
lines are the best linear fits; fitting parameters are inset. Each 
point represents one experimentally observed trajectory. Tra- 
jectories were 30,000 At units long, and errors were calculated 
for around 600 trajectories. 

Figure [3] compares one experimental third cumulant 
with the predicted value from Caliber obtained from 
the measured first moments. These predictions are also 
in good agreement with experiments, although, because 
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FIG. 3: Experiments vs. theory for the covariance and 
third cumulant. Left: one covariance quantity. Right: The 
third cumulant of Nba- The dashed lines are the best linear 
fits; fitting parameters are inset. 



higher cumulants involve higher derivatives and more 
data, the scatter is larger than for lower moments. The 
first moments are easy to measure with good accuracy 
from short trajectories, so one virtue of the Caliber ap- 
proach is that all the higher cumulants, which would re- 
quire much longer trajectory data, can be predicted from 
short-trajectory information. 

Figure|3]also shows the quantity (NBN a b) — (NB)(N a b). 
These covariances, equivalent to mixed moments, give an 
alternative way to express reciprocal relationships resem- 
bling the Maxwell relations of thermodynamics and On- 
sager's reciprocal relations for dynamical processes near 
equilibrium. In essence, this means that one trajectory 
observation counts for two: small perturbations on a 
trajectory are equivalent to observing covariances; thus, 
without performing additional experiments or recalculat- 
ing Qd, we know how the system will behave - just looking 
at the fluctuations is enough. 

Using the matrix form of Qd, we can compute the prob- 
ability distribution of trajectories; we show this for the 
ratio Na/Nb = K. As t — > oo, this ratio simply be- 
comes equal to the equilibrium constant K eq for the rel- 
ative populations of the two states A and B. In the 
small-time limit, this ratio quantity has a distribution 
of values. Figure [4] shows these distributions for a sit- 
uation in which the average is (Na/Nb) ~ L The dis- 
tribution approaches a r5-function as t — * oo and thus 
K — > K eq . In diffusion-related problems, small- numbers 
situations in which particles flow up concentration gra- 
dients, rather than down, have been referred to as "bad 
actors" [12] ; the number of bad actors diminishes as tra- 
jectories get longer. Agreement between computation 
of Qd and measurements demonstrates that a partition 
function approach accurately represents the probability 
distribution of trajectories. 

In summary, we have studied a single colloidal particle 
undergoing a two-state process, A ±=> B, with station- 
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FIG. 4: The probability distribution of N A /N B = K eq 
as a function of time. We obtain the dashed line from 
Monte Carlo simulation of Qd and corresponding columns 
from experimental data. The distribution of time spent in 
A versus B is broad for short times (left) (many bad actors) 
but becomes narrower for increasing trajectory length (right) 
(fewer bad actors). N denotes the length of each trajectory, 
each repeated around 100 times. As the length of trajectories 
increases, the equilibrium constant assumes a delta-function 
distribution, commensurate with equilibrium assumptions re- 
garding chemical reactions. 



ary rates. By measuring short trajectories, we obtain 
first moment observables (Nbb), (N aa ), (Nb a ), and (N a b). 
The variational principle of Maximum Caliber is then 
used to predict the higher cumulants of the observables 
as well as the full probability distribution of the trajecto- 
ries. Curiously, Maximum Caliber also provides the re- 
sponse function to trajectory perturbation characterized 
by Maxwell-like relations. Trajectory-based dynamical 
modeling such as this may be useful in single-molecule 
and few-molecule science. 
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Appendix 

Suppose we have a set of i = 1,2, ...,s trajectories. 
We aim to determine the probability p t of each tra- 
jectory. We define an entropy-like quantity called Cal- 
iber, C, over the micro-trajectories (rather than over mi- 
crostates), subject to dynamical constraints. 



(5) 



where j indexes first moment constraints, for instance 
(N aa ) = Y\ N aai Pi- 

Caliber prescribes that the observed distribution of 
trajectories will be those p^s that maximize C, = 



0. The corresponding statistical weights are given by 
a = exp(-A aa ), (3 = exp(-A 6b ), ujf = exp(-A a6 ), and 
uj r = cxp(— Aba), where the A's are the Lagrange multi- 
pliers. These Lagrange multipliers can be interpreted as 
log transition probabilities, in the same spirit of physical 
interpretation that we assign to the Lagrange multipliers 
of equilibrium statistical mechanics. 

As the number of time steps increases, using the largest 
eigenvalue of G as a proxy for Q d becomes more accu- 

.... . , e a+!3+J{a-l3) 2 +iuj } u) r 

rate; it is given by £ = k — . ihereiore, 

for sufficiently long trajectories, we can express all cumu- 
lants of the observables analytically in terms of partial 
derivates of £. 
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